Utilizing classification and text analytics for optimizing processes in documents

ABSTRACT

Classification and text analytics are used to evaluate passages, extract text, identify concepts, and provide displayable and searchable notations to assist document editors in identifying and evaluating conflicting or duplicate directives (also called policies or rules) within a large document.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is related to application Ser. No. 13/710,025(corresponding to IBM Docket No.: SVL920120098US1), filed on Dec. 10,2012, entitled “Utilizing Classification and Text Analytics forAnnotating Documents to Allow Quick Scanning” by Barton W. Emanuel, MarkW. Paulis, and Mark L. Roboff, which application is incorporated byreference herein.

BACKGROUND

1. Field of the Invention

The present invention relates generally to evaluating documents, and inparticular, to a method, apparatus, and article of manufacture forutilizing classification and text analytics to evaluate passages,extract text, identify concepts, and provide displayable and searchablenotations to assist document editors in identifying and evaluatingconflicting or duplicative directives within a large document.

2. Description of the Related Art

As large operational documents grow, the human editors of thesedocuments may find it more difficult to edit the directives in thedocuments without accidentally creating conflicting or duplicatedirectives. The document may also become too large for a human editor toconsolidate and even too complicated for human readers to understand andfollow the directives. A system to automatically highlight, organize,and search document directives would enable editors to eliminateduplicate, conflicting, or missing directives and increase businessefficiency of editors and readers.

For example, many government agencies have a records classificationmanual. In many cases, this document has been edited over the course ofdecades to contain hundreds of pages and thousands of classificationdirectives. The document is so large that readers find it difficult tofollow the rules, and editors find it too challenging to consolidate thedocument. To tackle the problem, it is common for individuals to spendmonths or years of their career to specialize and become an expert in asingle chapter of the document. This intensive human effort still doesnot correctly tackle the problem, as conflicts and duplicates stillarise between chapters. Lead industry subject matter experts are notaware of an automated solution to this problem. Thus, an automatedsystem to highlight duplicate and conflicting classification directiveswould enable the editors to accomplish in minutes what had previouslytaken them months to accomplish.

SUMMARY

A computer-implemented method provides the ability to analyze adocument. A document is received/generated and text is extracted from anative form of the document. The document is separated into two or morephysical sections. Using text analytics, one or more directives areidentified within the text. Based on the directives, annotations aregenerated within the physical sections. The annotations are compared toidentify duplicate annotations and conflicting annotations. Theannotations and results of the comparison of the annotations aredisplayed in a searchable interface.

A computer program product analyzes a document. The computer programproduct is a computer readable storage medium having program codeembodied therewith. The program code is executable by a device andperforms various operations. The program code receives, by the device,the document. The program code extracts, by the device, text of thedocument from a native form of the document. The program code separates,by the device, the document into two or more physical sections. Theprogram code identifies, by the device, using text analytics, one ormore directives within the text. The program code generates, by thedevice, based on the one more directives, annotations within the two ormore physical sections. The program code compares, by the device, theannotations to identify duplicate annotations and conflictingannotations. The program code displays, by the device, the annotationsand results of the comparison of the annotations in a searchableinterface.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Referring now to the drawings in which like reference numbers representcorresponding parts throughout:

FIG. 1 illustrates a pictorial representation of a network dataprocessing system used in accordance with one or more embodiments of theinvention;

FIG. 2 illustrates a block diagram of a data processing system that maybe implemented as a server in accordance with an embodiment of thepresent invention;

FIG. 3 illustrates a block diagram of a data processing system inaccordance with an embodiment of the present invention;

FIG. 4 illustrates a system used to annotate/analyze a document inaccordance with one or more embodiments of the invention; and

FIG. 5 illustrates the logical flow for analyzing a document inaccordance with one or more embodiment of the invention.

DETAILED DESCRIPTION

In the following description, reference is made to the accompanyingdrawings which form a part hereof, and which is shown, by way ofillustration, several embodiments of the present invention. It isunderstood that other embodiments may be utilized and structural changesmay be made without departing from the scope of the present invention.

Overview

Embodiments of the invention use classification and text analytics toevaluate passages, extract text, identify concepts, and providedisplayable and searchable notations to assist document editors inidentifying and evaluating conflicting or duplicate directives (alsocalled policies or rules) within a large document. Text analytics arefirst used to identify all directives located within the text of thedocument. A classifier is then used to determine the type of directive.A check is then performed for duplicate language, directive numbers, orimportant facts, so that an editor can quickly and easily identifyduplicate, conflicting, and/or missing directives.

Hardware Environment

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent invention may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present invention are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

With reference now to FIG. 1, a pictorial representation of a networkdata processing system 100 is presented in which the present inventionmay be implemented. Network data processing system 100 contains anetwork 102, which is the medium used to provide communications linksbetween various devices and computers connected together within networkdata processing system 100. Network 102 may include connections, such aswire, wireless communication links, or fiber optic cables etc.

In the depicted example, server 104 is connected to network 102 alongwith storage unit 106. In addition, clients 108, 110, and 112 areconnected to network 102. These clients 108, 110, and 112 may be, forexample, personal computers or network computers. In the depictedexample, server 104 provides data, such as boot files, operating systemimages, and programs to clients 108, 110 and 112. Clients 108, 110 and112 are clients to server 104. Network data processing system 100 mayinclude additional servers, clients, and other devices not shown. In thedepicted example, network data processing system 100 is the Internetwith network 102 representing a worldwide collection of networks andgateways that use the TCP/IP suite of protocols to communicate with oneanother.

Referring to FIG. 2, a block diagram of a data processing system thatmay be implemented as a server, such as server 104 in FIG. 1, isdepicted in accordance with an embodiment of the present invention. Dataprocessing system 200 may be a symmetric multiprocessor (SMP) systemincluding a plurality of processors 202 and 204 connected to system bus206. Alternatively, a single processor system may be employed. Alsoconnected to system bus 206 is memory controller/cache 208, whichprovides an interface to local memory 209. I/O bus bridge 210 isconnected to system bus 206 and provides an interface to I/O bus 212.Memory controller/cache 208 and I/O bus bridge 210 may be integrated asdepicted.

Peripheral component interconnect (PCI) bus bridge 214 connected to I/Obus 212 provides an interface to PCI local bus 216. A number of modemsmay be connected to PCI local bus 216. Typical PCI bus implementationswill support four PCI expansion slots or add-in connectors.Communications links to network computers 108, 110 and 112 in FIG. 1 maybe provided through modem 218 and network adapter 220 connected to PCIlocal bus 216 through add-in boards. Additional PCI bus bridges 222 and224 provide interfaces for additional PCI local buses 226 and 228, fromwhich additional modems or network adapters may be supported. In thismanner, data processing system 200 allows connections to multiplenetwork computers. A memory-mapped graphics adapter 230 and hard disk232 may also be connected to I/O bus 212 as depicted, either directly orindirectly.

Those of ordinary skill in the art will appreciate that the hardwaredepicted in FIG. 2 may vary. For example, other peripheral devices, suchas optical disk drives and the like, also may be used in addition to orin place of the hardware depicted. The depicted example is not meant toimply architectural limitations with respect to the present invention.

The data processing system depicted in FIG. 2 may be, for example, anIBM e-Server pSeries system, a product of International BusinessMachines Corporation in Armonk, N.Y., running the Advanced InteractiveExecutive (AIX) operating system or LINUX operating system.

Server 104 may provide a suitable website or other internet-basedgraphical user interface accessible by users to enable user interactionfor aspects of an embodiment of the present invention. In oneembodiment, Netscape web server, IBM Websphere Internet tools suite, anIBM DB2 for Linux, Unix and Windows (also referred to as “IBM DB2 forLUW”) platform and a Sybase database platform are used in conjunctionwith a Sun Solaris operating system platform. Additionally, componentssuch as JBDC drivers, IBM connection pooling and IBM MQ seriesconnection methods may be used to provide data access to severalsources. The term webpage as it is used herein is not meant to limit thetype of documents and programs that might be used to interact with theuser. For example, a typical website might include, in addition tostandard HTML documents, various forms, Java applets, JavaScript, activeserver pages (ASP), Java Server Pages (JSP), common gateway interfacescripts (CGI), extensible markup language (XML), dynamic HTML, cascadingstyle sheets (CSS), helper programs, plug-ins, and the like.

With reference now to FIG. 3, a block diagram illustrating a dataprocessing system is depicted in which aspects of an embodiment of theinvention may be implemented. Data processing system 300 is an exampleof a client computer. Data processing system 300 employs a peripheralcomponent interconnect (PCI) local bus architecture. Although thedepicted example employs a PCI bus, other bus architectures such asAccelerated Graphics Port (AGP) and Industry Standard Architecture (ISA)may be used. Processor 302 and main memory 304 are connected to PCIlocal bus 306 through PCI bridge 308. PCI bridge 308 also may include anintegrated memory controller and cache memory for processor 302.Additional connections to PCI local bus 306 may be made through directcomponent interconnection or through add-in boards. In the depictedexample, local area network (LAN) adapter 310, Small computer systeminterface (SCSI) host bus adapter 312, and expansion bus interface 314are connected to PCI local bus 306 by direct component connection. Incontrast, audio adapter 316, graphics adapter 318, and audio/videoadapter 319 are connected to PCI local bus 306 by add-in boards insertedinto expansion slots.

Expansion bus interface 314 provides a connection for a keyboard andmouse adapter 320, modem 322, and additional memory 324. SCSI host busadapter 312 provides a connection for hard disk drive 326, tape drive328, and CD-ROM drive 330. Typical PCI local bus implementations willsupport three or four PCI expansion slots or add-in connectors.

An operating system runs on processor 302 and is used to coordinate andprovide control of various components within data processing system 300in FIG. 3. The operating system may be a commercially availableoperating system, such as Windows XP®, which is available from MicrosoftCorporation. An object oriented programming system such as Java may runin conjunction with the operating system and provide calls to theoperating system from Java programs or programs executing on dataprocessing system 300. “Java” is a trademark of Sun Microsystems, Inc.Instructions for the operating system, the object-oriented operatingsystem, and programs are located on storage devices, such as hard diskdrive 326, and may be loaded into main memory 304 for execution byprocessor 302.

Those of ordinary skill in the art will appreciate that the hardware inFIG. 3 may vary depending on the implementation. Other internal hardwareor peripheral devices, such as flash ROM (or equivalent nonvolatilememory) or optical disk drives and the like, may be used in addition toor in place of the hardware depicted in FIG. 3. Also, the processes ofthe present invention may be applied to a multiprocessor data processingsystem.

As another example, data processing system 300 may be a stand-alonesystem configured to be bootable without relying on some type of networkcommunication interface, whether or not data processing system 300comprises some type of network communication interface. As a furtherexample, data processing system 300 may be a Personal Digital Assistant(PDA) device, which is configured with ROM and/or flash ROM in order toprovide non-volatile memory for storing operating system files and/oruser-generated data.

The depicted example in FIG. 3 and above-described examples are notmeant to imply architectural limitations. For example, data processingsystem 300 may also be a notebook computer or hand held computer as wellas a PDA. Further, data processing system 300 may also be a kiosk or aWeb appliance. Further, the present invention may reside on any datastorage medium (i.e., floppy disk, compact disk, hard disk, tape, ROM,RAM, etc.) used by a computer system. (The terms “computer,” “system,”“computer system,” and “data processing system” and are usedinterchangeably herein.)

Software Embodiments

FIG. 4 illustrates a system 400 used to annotate/analyze a document inaccordance with one or more embodiments of the invention. System 400 maybe implemented by one or more servers 104, clients 108, 110, and 112,and/or any other components described above and set forth in FIGS. 1-3.

System 400 consists of a document 402, a text extractor 404 that mayinclude the use of a corresponding glossary 406, a separator 408, a textanalyzer 410 with a lexical ontology 412 for directives, a classifier414 with a domain specific dictionary 416, a duplicate analyzer 418 andconflict comparator 420, a search (and display) server/interface 422with a notation index 424, multi-document comparison 426, and a texthighlighter 428.

FIG. 5 illustrates the logical flow for analyzing a document inaccordance with one or more embodiment of the invention. The followingdescription refers to the steps of FIG. 5 and the components of FIG. 4.For any given document 402, the steps of FIG. 5 may be performed. As setforth herein, the steps of FIG. 5 are performed by system 400 of FIG. 4without user input. In other words, the evaluation and annotation of thedocument may be performed automatically, and dynamically, without userinterference. Accordingly, human interaction with the system 400 is notneeded as the system 400 automatically evaluates the text and annotatesthe documents without further user input and without relying on a basemodel established manually by other users.

At step 502, a document 402 is received/generated.

At step 504, a text extractor is used to extract the text of thedocument from the native document form (e.g., extract text from a PDFdocument). In addition, this step may include the extraction of aglossary 406 from within the document. Such a glossary may include alexical ontology 412 and or a domain specific dictionary 416. Such aglossary 406 may be found at the end of the document being processed(although it may also exist in another related document beingprocessed). The glossary 406 is utilized to improve the quality of adirective classification. In this regard, a lexical ontology 412 of theglossary 406 may be used by a text analyzer 410 to identify directives.Alternatively (or an in addition), the domain-specific dictionary 416 ofthe glossary 406 may be used by a classifier 414 to identify domainspecific keywords within the text/annotations in order to group theannotations/text.

At step 506, a separator 508 is used to separate the document. Such astep may separate the document 502 into two or more physical sections.The manner in which the document 502 is separated may be configurablebased on logical attributes of the document. For example, a user mayconfigure the separator 408 to separate the extracted text based onparagraphs, carriage returns, pages, spaces, particular characters(e.g., semicolon), etc.

At step 508, directives in the text are identified using a textanalytics system 410. A lexical ontology 412 may be used to identifydirectives in the extracted text. Such directives may be a policy or arule. For example, if the document 402 is a government manual/guide, apolicy/rule within a section/chapter of the manual may provide fordestroying microfiche after three (3) years. The text analytics system410 identifies such directives in the text.

At step 510, the output from the text analytics system 410 areannotations within the various physical sections. Examples of theannotations include (or may selected from a group consisting of) a partof speech, a phrase, a proper name, a location, a business entity, adomain specific keyword or concept, and a relationship referenced by anydirectives.

Step 510 may also include the classifier 414 classifying the annotationsinto groups based on one or more attributes of the directives. Forexample, annotations pertaining to directives that relate to the sametopic may be grouped together (e.g., any directive that relates tomicrofiche, or all directives in a particular section/paragraph, etc.).The classifier may utilize a domain-specific dictionary 416 of glossary406.

At step 512, the annotations are compared/analyzed. In this regard, theannotations may be indexed (resulting in an annotation index 424), andthen compared for duplicate and/or conflicting annotations (e.g., usingduplicate analyzer 418 and/or conflict comparator 420). For example, ifthe same document repeats the same three-month microfiche destructiondirective, the duplicate analyzer 418 will identify such a duplicatedirective. Similarly, if one directive provides for destroyingmicrofiche in three months while a second directive provides fordestroying microfiche in one year, the conflict comparator 420 willidentify such a conflict.

The indexed annotations 424 may also be combined with annotations fromother documents for the comparison 512 (e.g., for cross-documentcomparison 426). If the classifier 414 has classified the annotationsinto various groups, the comparison may also be based on such groups(e.g., comparing annotations within the same group, or by comparinggroups to each other, etc.).

At step 514, the annotations and results of the comparison are displayedin a searchable interface (e.g., via a search and display server 422)that may include text highlighting 428 to easily identify the locationof annotations and directives (and/or relevant annotations anddirectives) in the text. Thus, text containing directives or anannotation (e.g., duplicates or conflicting) may be highlighted ordisplayed in a visually distinguishable manner (e.g., different font,font size, color, etc). The user may also have the option to display ornot display such a highlighting or to display/not display annotationswith certain properties/attributes (e.g., conflicting or duplicate).

In addition to the above, the comparing step 512 and display step 514may be performed dynamically while a document is being edited. Forexample, if a user is editing a government manual, and enteringinformation about how to handle microfiche, the system 400 maydynamically determine that other directives relating to microfichealready exist in a different section of the manual, and displayinformation relating to such an existing directive. Alternatively, thesystem 400 may perform such a comparison 512 and displaying 514 once theediting is complete.

In view of the above, embodiments of the invention provide the abilityto extract text from a document, separate/chop up the text into varioussections, use text analytics to extract/identify important portions ofthe text and output annotations, classify the annotations into variousgroups, determine if there are any duplicate and/or conflictingdirectives/annotations, and display results of such adetermination/comparison.

CONCLUSION

This concludes the description of the preferred embodiment of theinvention. The following describes some alternative embodiments foraccomplishing the present invention. For example, any type of computer,such as a mainframe, minicomputer, or personal computer, or computerconfiguration, such as a timesharing mainframe, local area network, orstandalone personal computer, could be used with the present invention.

In summary, embodiments of the invention provide the ability to useclassification and text analytics to evaluate passages, extract text,identify concepts, and provide displayable and searchable notations toassist document editors in identifying and evaluating conflicting orduplicated directives (also called policies or rules) within a largedocument. Text analytics are first used to identify all directiveslocated within the text of a document. A classifier may then be used todetermine the type of directive. The results are then checked forduplicate language, directive numbers, or important facts, so that aneditor can quickly and easily identify duplicate, conflicting, ormissing directives. Thus, embodiments of the invention may operate on asingle document to separate the document into physical sections and thenapply text processing techniques to those sections (e.g., allowing asingle document to be compared to itself and improved, such asautomatically finding redundant and duplicate concepts in the document).

The foregoing description of the preferred embodiment of the inventionhas been presented for the purposes of illustration and description. Itis not intended to be exhaustive or to limit the invention to theprecise form disclosed. Many modifications and variations are possiblein light of the above teaching. It is intended that the scope of theinvention be limited not by this detailed description, but rather by theclaims appended hereto.

1-9. (canceled)
 10. A computer program product for analyzing a document,the computer program product comprising a computer readable storagemedium having program code embodied therewith, the program codeexecutable by a device to: receive, by the device, the document;extract, by the device, text of the document from a native form of thedocument; separate, by the device, the document into two or morephysical sections; identify, by the device, using text analytics, one ormore directives within the text; generate, by the device, based on theone more directives, one or more annotations within the two or morephysical sections; compare, by the device, the annotations to identifyduplicate annotations and conflicting annotations; and display, by thedevice, the annotations and results of the comparison of the annotationsin a searchable interface.
 11. The computer-program product of claim 10,wherein the program code, that separates the document into two or morephysical sections, is configurable based on one or more logicalattributes of the document.
 12. The computer-program product of claim10, wherein the one or more directives comprise a policy.
 13. Thecomputer-program product of claim 10, wherein the one or more directivesare based on and selected from a group consisting of a part of speech, aphrase, a proper name, a location, a business entity, a domain specifickeyword or concept, and a relationship referenced by one of the one ormore directives.
 14. The computer-program product of claim 10, whereinthe program code is further executable by the device to: extract, by thedevice, a glossary within the one or more documents to be used foridentifying the one or more directives.
 15. The computer-program productof claim 10, wherein the program code is further executable by thedevice to: classify, by the device, the annotations into groups based onone or more attributes of the directives; and wherein the program codecompares the annotations based on the groups.
 16. The computer-programproduct of claim 10, wherein the program code is further executable bythe device to: index, by the device, the annotations; and combine, bythe device, the annotations with second annotations from anotherdocument; and wherein the program code compares the annotations bycomparing the annotations with the second annotations.
 17. Thecomputer-program product of claim 10, wherein the program code isfurther executable by the device to: highlight, by the device, the textthat contains one or more directives; and highlight, by the device, thetext that contains one or more annotations.
 18. The computer-programproduct of claim 10, wherein the program code compares and displaysdynamically while the document is being edited.
 19. A system foranalyzing a document comprising: a text extractor configured to extracttext of the document from a native form of the document; a separatorconfigured to separate the document into two or more physical sections;a text analyzer configured to: identify, using text analytics, one ormore directives within the text; and generate, based on the one moredirectives, one or more annotations within the two or more physicalsections; a comparator configured to compare the annotations to identifyduplicate annotations and conflicting annotations; and a searchableinterface configured to display the annotations and results of thecomparison of the annotations.
 20. The system of claim 19, wherein theone or more directives comprise a policy.
 21. The system of claim 19,wherein the one or more directives are based on and selected from agroup consisting of a part of speech, a phrase, a proper name, alocation, a business entity, a domain specific keyword or concept, and arelationship referenced by one of the one or more directives.
 22. Thesystem of claim 19, further comprising: extracting a glossary within theone or more documents to be used for identifying the one or moredirectives.
 23. The system of claim 19, further comprising: classifyingthe annotations into groups based on one or more attributes of thedirectives; and wherein the comparing is further based on the groups.24. The system of claim 19, further comprising: indexing theannotations; and combining the annotations with second annotations fromanother document; and wherein the comparing comprises comparing theannotations with the second annotations.
 25. The system of claim 19,further comprising: highlighting the text that contains one or moredirectives; and highlighting the text that contains one or moreannotations.